Papers with Story video-text alignment
Multilingual Synopses of Movie Narratives: A Dataset for Vision-Language Story Understanding (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Story video-text alignment is a core task in computational story understanding, but its progress has been held back by the scarcity of manually annotated video- text correspondences and the heavy concentration on English narrations of Hollywood movies. |
| Approach: | They construct a multilingual video story dataset with 13,166 movie summary videos from 7 languages and manual annotations of fine-grained video-text correspondences. |
| Outcome: | The proposed approach outperforms the SOTA methods on clip accuracy and Sentence IoU scores. |